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ABSTRACT 



The student variables associated with scoring above the 
international mean on the Third International Mathematics and Science Study 
(TIMSS) were studied in a group of U.S. students who took advanced 
mathematics or advanced mathematics and physics. The total sample was 2,349, 
with 1,158 females and 1,191 males. Formal parent education level and gender 
were significantly associated with scoring above the international mean, 
showing that this traditionally observed disparity still exists. Students 
enrolled in both advanced mathematics and advanced physics were three times 
as likely to score above the international average as students enrolled only 
in advanced mathematics. Results show that the more a student believed that 
natural talent was the key to mathematics success, the more likely the 
student scored above the international average, and the less a student 
believed that hard work was the key to mathematics success, the more likely 
the student scored over the international average. In addition, scoring above 
the international average was associated with more time studying and less 
time in nonacademic activities. The most disturbing finding from the study 
may be that only 26% of the most advanced students scored above the 
international mean, suggesting that the most advanced students in the Untied 
States are not reaching the level one would expect. An appendix lists the 
variables considered. (Contains 39 references.) (SLD) 
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Background 

The intense concern over the mathematics achievement levels of United States 
elementary and high-school students can be seen through the number of articles published 



(Baker, 1993a, 1993b; Bracey, 1991, 1992, 1993; Freudenthal, 1975, Rotberg, 1990; 
Stedman, 1994a, 1994b). A great deal of debate has centered on the fact that the U.S 



scored lower than many countries on most of the assessments. Very little discussio 
focused on U.S. high school seniors and on the factors that are associated with scoring 
above the international mean. The questions which motivate this study are; What student 
variables are associated with scoring above the international mean on the TIMSS 
advanced mathematics test? How much of an impact do these variables make for those 



students who scored above the international average? 

Theoretical Framework 

Over the past few decades a great deal of research has been conducted on the 
student level factors that impact mathematics achievement. The positive relationship 
between attitude (ATT) and achievement (ACH) has long been observed (Ethtngton & 
Wolfe, 1984, 1986; Lester, Garafalo, & Kroll, 1989; Ma, 1997; Suydam & Weaver, 

1975). Ma and Kishnor (1997) conducted a meta-analysis concerning the effect of 
mathematical self-concept and achievement in mathematics (ACH). They found a 
significant effect size of .23 (statistically different than zero) for self-concept about 
mathematics and ACH. The authors concluded that a positive self-concept about 
mathematics is associated with higher achievement in mathematics. Ma (1997) observed 
that attitudes towards mathematics (e.g., importance, difficulty, enjoyment) influenced 
achievement. As crucial as attitude towards mathematics is for mathematics achievement, 
understanding a student’s academic related beliefs is also an important key to 
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comprehending the achievement level (Dweck, & Elliot, 1983; Felson, 1984). Academic 
beliefs have been observed to impact the achievement level of students (Dweck & Elliot, 
1983). Schoenfeld (1985) has pointed out that students’ beliefs about mathematics may 
impede their ability to solve problems. 

Extracurricular activities (EA) for students have been glorified and chastised over 
the years (Gerber, 1996). Two main of views of EA exist. The first view is that 
extracurricular activity is similar to a zero sum game where greater activity will subvert 
academic achievement (Coleman, 1961; Marsh, 1992). The second view is that EA 
experiences “further the total development of the students,” thereby enhancing non- 
academic goals and possibly facilitating academic goals (Holland & Andre, 1987). 

More specifically, part time employment, a common activity for American high 
school students, has shown to have a negative influence on achievement (e.g., Brown & 
Steinberg, 1991; Cooper et al., 1999), a positive influence (D’Amico, 1984), or no 
influence (Green & Jacquess, 1987). Cooper, et al. (1999), reported that number of hours 
per week was significantly negatively associated with a standardized test (-.29) and with 
teacher assigned grades (-.17). With 51.6% of high school senior female students and 
47.5 percent of high school senior male students working, the examination of the effects 
of employment on achievement should continue (Green, Dugoni, Ingels, and Cambum, 
1995). 

Another common extracurricular activity is athletics (e.g., football, softball, 
baseball, soccer, track, and basketball). A review of research by Holland and Andre 
(1987) focused on the examination of the relationship between athletic participation and 
achievement. They reported that the research demonstrated that male high school athletes 
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-eived somewhat higher grade-point averages (CPA's) than did non-athletes. When one 
considers standardized achievement or aptitude tests, maies, whose only after schoo. 
activity is sports, scored lower than nations, averages on the Standards Achievement 
Test. No significant difference in either grade-point average or standard test scores 
was observed between female athletes and non-athletes. 

Another common after schoo, activity associated with achievement is homework. 

cooper (1989) observed a positive linear telationship between hours per week spent on 
homework (0 to 10 hrs) and achievement. 

Television has traditionally been assumed to lessen achievement (Comstock 
*991, Keith e, ah, ,986). Simply, television viewing displaces academic activities and 
reduces the amount of time available for completing homework and other academic 
activities, thereby reducing achievement. Keith, et ah, (,986) observed a small but 
negative relationship between the amount of television watched and achievement In a 
review of tesearch, Williams, Haeftel, Haenel, and Walberg (,982) observed that the 
effect changes across the range of viewing times. The effect is vety slightly positive up to 
,en hours per week and then becomes negative. The negative effect tnceases and is 
exneme after thirty hours per week. A mom mcen, study by Cooper e, ah, (,999) 

observed a significant negative association between achievement and tension viewing 
(mean viewing was 1-2 hours per night). 

Differences in achievement for male and female students have been observed 
(More & Smith, 1987; Sherman, 1987; Anderson, ,989). Cuttemly , here is sti „ de5ate 
about the observed differences. Some reseamhers have observed a large diffetence 
(Benbow & Stanley, 1980) and some no difference (Radhawa, Beamer. & Lundberg 



ERiC 



□ 



Scoring Above 



5 



1993). The more consistent finding in the research appears to be that some differences 

I . r 

still exist but not in all areas of mathematics (Fennema & Carpenter, 1981). Numerous 
research articles have been written concerning family background variables such as 
parental SES or parent education. (Keith & Cool, 1992; Lockheed and Komenan, 1989, 
McConeghy, 1987; Santiago and Okley, 1992). The positive relationship between 
parental socio-economic status (SES) or parent education level and achievement has been 
consistently observed (Heyns, 1978; Goleman, 1988). Similar results for SES have been 
observed in multilevel modeling (Lee & Bryk, 1989). The average school SES has been 
observed to be significantly related to mean school achievement in mathematics (the 
higher the school SES the higher the mean achievement) (Lee & Bryk, 1989; Raudenbush 
& Bryk, 1986). 

Methodology 

Sample 

The sample for this study consists of the U.S. students from the Third 
International Mathematics and Science Study (TIMSS) Population 3 final year of 
secondary school cohort (High School Seniors) who were administered test booklets 3A, 
3B, or 3C (Advanced Mathematics). All students who were administered the advanced 
mathematics instrument were designated advanced mathematics students or advanced 
mathematics and physics students. Total sample size is 2349 with 1158 females and 1191 
males. 

Analysis 

To answer the research questions posed, a logistic regression analysis was 
conducted. The analysis was run in blocks. The first block contained background 
variables: Parent Education, Gender (Female), Math/Physics Expert. The second block 
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fna, block included the previous two blocks and time variables: Television, 
Employment, Sports, Studying Math. 

Variables 

A bating of each variable, TfMSS label, and coding i„f orm a t io„ „ provided in 
Appendix A. The dichotomous outcome variable is based on the first plausible value of 
•be advanced mathematics test. Students who scored over the international average 50, 
were coded as one, and students who scored below the international average were coded 



as zero. 



The independent variables am categorized into three amas: 

^rountofSn which is composed of, Pare „ t Nation (dummy coded), 
Gender (Female), and Advanced Math/Physics; 

After SCool Time, which is composed of. Television Viewing, Employment, 
Sports, and Studying Math; 

Affecnve Factors, which is composed of Attitude, Natural 
Work Belief. 



Talent Belief, Hard 



Results 

Tables 1 and 2 provides descriptive statistics 

provides results from the fiom the logistic regmssion analysis. Bloch , results indicate 
that parental education, gender (female) and advanced mathemabcs ; 
significantly related to scoring above international 



of the variables used. Table 3 



and physics were 



^J^gXTabulations of Dichorom... 



mean. Taking the exponential of the 



Gender 

Male 

Female 



Variable 



Count 



1191 

1158 



s Variables 
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Advanced Math/P hysics 



Advanced Math 



1064 



Advanced Math and Physics 



1285 



'Parent Education 1 (High School^ 



No = 0 
Yes = 1 



1298 



888 



les = i — - 

Parent Education (E lem. School) 



No — 0 t“ rz-7 ' . 

. university, 8 88 horn U*** * 



2019 



1 . 

elementary school. 



Table 2 Descriptive Stati sticsfaX^^ 

T sd mm. 




coefficient for advanced mathematics and physics (e* 1.105) provides an odds ratio of 
3.019 which indicates that students enrolled in advanced mathematics and physics were 
three times as likely to score above the international average than students only enrolled 
in advanced mathematics. Students whose parents had only completed elemental school 
(e*-l .368) were only one-fourth as likely to score above the international mean. The 
Hosmer and Lemeshow statistic indicates that the model was a good fit. The Cox and 
Snell and Nagelkerke R-Square values indicate less than 20 percent of the variance was 
accounted with the Block 1 variables. These values are analogous to the traditional R- 
Square in multiple regression, but are specific to logisttc regression due to the 



dichotomous dependent variable. 

The results from the Block 2 analysis indicate that all the variables, except 
Gender, were significantly related to scoring above the international mean. This indicated 
the possibility of an interaction between female and the affective variables. Since the 
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interaction of affective variables and gender a* well docntnented (McLeod, 1992, 
intermediate models wete ran (Table 4, to examine tbe association of interactions In the 

glockl Block-9 1 I r>i ■ ■ 



High School 



Elem. School 
Gender (Female 



Advanced Math & 
Physics 



Attitude 



Natural Talent 



Hard Work 



TV 



-1.172 

-1.368 

-0.375 

1.105 



se 



0.17 

0.25 

0.10 

0.11 



Beta 



Job 



Sport! 



Math Study 



-21og 





Hosmer-Lemeshow 

X 2 

Cox & Snell R r 



Nagelkerke R z 



2260,85 



5.823 

df=6 

.126 

.183 



-1.313 

-1.699 

-0.209 

0.976 

-0.266 

-0.455 

0.392 



se 



2007.13 



8.66 

df=8 

.214 

.309 



0.12 

0.28 

0.11 

0.12 

0.02 

0.08 

0.08 



Beta 



-1.252 

-1.756 

-0.392 

0.913 

-0.256 

-0.457 

0.499 

-0.166 

-0.172 

-0.163 

0.272 



se 



1938.44 



5.968 

df=8 

.231 

•335 



0.12 

0.28 

0.12 

0.12 

0.02 

0.08 

0.08 

0.06 

0.05 

0.04 

0.08 



■node, (Gender* Attitude, Ge„der*HardWork, Ge„der* N a,ura, Taient). The internets 
wem no, s,gnificant, the -2,og did no, significant,, change, and the R-S q uare esttmates 
were not significantly altered. According to H osmer and Lemeshow (,989) this indicates 
that affect may be a confounder but not an effect mediator. 

■^^B^SgSgofOsnder and Affect Interaction 



_Gender*Attitude 



_Gender*Natural Talent 




Aiso, after tnciuding affect vanabies -in essence statistical conttoiling for the 
assoc, atton of affect- changes in the negative association of forma, pamn, education 
changes were evident. The coefficients for both variables increased. The impact of being 
enrolled ,n advanced mathematics and physics had a decrease in assoc, ation from Block , 
.0 Block 2. For the continuous variable Attitude, the results indicam the wome the 
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students attitude the less likely the student scored over the international average. The 
coefficient for Natural Talent indicates that the more a student believed that natural talent 
was a key to mathematics success the more likely the student scored above the 
international average. Finally, the less a student believed in hard work as a key to 
mathematics success the more likely the student scored over the international average. 

The -2 log value dropped from Block 1 to Block 2 and the Hosmer Lemeshow 
statistic indicates that the Block 2 model is a good fit for the data. Finally, The R-square 
estimates indicate more “variance” was accounted for by the inclusion of the affect 
variables which was expected. 

Block 3 results indicate that the variables from Blocks 1 and 2 and the new 
variables are significantly associated with scoring above the international mean. Taking 
the exponential of the Studying Math coefficient (e A .272) shows that for every one unit 
increase on the scale the student is 1.3 times more likely to score above the international 
average. For every one unit increase in work the students eight tenths as likely to score 
above the international mean. 

From Block 2 to Block 3 the variable Gender went from not significant to 
significant indicating a possible interaction with extracurricular activities. Therefore, 
these interactions (Gender*Television, Gender*Employment, Gender*Sports, 
Gender*Studying Math) were examined. None of the interactions were significant and 
including the interactions did not significantly change the -21og or the R-Square values 
(Table 5). 
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Though mostly completed with epidemiological teseamh, a probability equation 

can be developed to examine a student's probability of scoring above the international 
average. The equation is: 

n(x) = exp (A)/[1+ exp(A)], where 

A* 2.483 -1 . 252(HS) - 1.7561ES) . .392{Feml4.913 (AMPJ- ,256{Att) - ,457(N1} + ,499(HW) - ,166(TV) - 
• 1 ^(Sports) - . 1 72(Job) +.272(MStdy). 

A male student whose parents graduated from college, is not enroiied in advanced 
nra, hematics and physics, has a good aditude towarfs mathematics and average scorn on 
behefs, watches TV, works, plays sports and studies a couple of houm per day, would 
have a value of 0,8 indicatmg a 48 percent pmbability of scoring above the international 
ping everything the same except making the student enrolled in both 
advanced mathematics and physics increases me value to .74. Using an equation such as 

th ' S 15 ° n,y USefUl ^ “ - * controlled, such as working and studying. 

Discussion/Conclusions 

^ thC PUbl,Ca, '° n ° f ^ -res and die discussion about the rank 

of Amencan students average score it was important to look at factors that were 

associated with seeing above the international mean. The advanced mathematics and 

advanced mathematics and physics students were chosen because there has been less 

emphasis on their performance. Using such a unique group of students ,, was hoped by 
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the author that traditional variables would not have a strong impact on sconng above or 
below the international average. Unfortunately, forma, parent educatton level and gender 
were significantly assoc, ated w„h scoring above the rntemational mean showing that this 
traditionally observed disparity still exists. This indicates that there is still a great deal of 
work to be done to Cose this gap. The results indicate a mom m-depth examine., on of 
this is needed. For example, a case study of two classroom of advanced mathemattcs 
students followed for a year in an attempt to understand why the disparity exists. 

The result for advanced mathematics and phystcs students was expected. Students 
who are concurrently enrolled in mathematics and physics courses see many of the same 



equations and solve many of the same types of problems. The dual coverage of content, 
amount of time with the material, similar activities in the courses, provides the students 
more opportunity to learn the content. Therefore, advanced mathematics and physics 
students are potentially spending twice as much time during each day with advanced 
mathematics problems. Another aspect that may be influencing the difference is an 
absuact to concrete repmsentation of the material (Danesi, 1993). A great deal of work 
completed in advanced mathematics courses may appear to students to be abstract. In the 
physics course those students may be seeing concrete representations of the abstract ideas 
from their mathematics course. The connection may have assisted the students who are 
enrolled in both course score above the international average. Bu, this too needs to be 
researched further to examine if this could be contributing to the observed difference or 
someth, ng else, such as students who are concurrently enrolled in bod, courses have more 



“ability” or a higher “IQ.” 
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affeC ' iVe faCt0re ' ~ - —— and monitor a. difficult t „ 

c ange. Being a fomier mathematics fust™, or, ^ author un<tetands ^ ^ ^ 

attempting to Cange atdtudes and beliefs that Have develop* over many yea[s ^ 
infant*, though, Ute .suits demons,., e that out most advanced students « 
impacted in a similar way as the rest of our mathematics students ( Schreiber, 2000) 
Affective factors a* associated with student performance and need to he consider 
Time variables, overaii, may he more rea dii y modified than affective facto. 

Their association is smaiier in the mode, than other variables, hut stii, significant As 
students engage more hours per day in these activities they may positive, y (studying, 
or negative* (TV, job, sports) impact performance. Scoring above the international 
average in this study is associated with less time in non-academic activities and more 
nme studying. The tssue is no, to remo ve these activities fccause they do provide a gma, 
deal of societal* beneficial effects (time management, responsibility, working as a 
group, school retention), hut to monitor the amount of tune and energy these activities are 
a « mg. Even wtthtn these observations, more in-depth tesea.lt needs to he conducted 
effects of different types of activities (e.g., school/non school, academic/non- 
academte, organized/unorganized) on achievement. 

The most dtsturhtng finding f rom *, study raay „ ot h from the mode] ^ 
international mean. I. does appear tha, our most advanced mathematics students am not 

- mg „ level we ezpect, and , 1 ha, many of ,e hadidonal variables are sdll assciated 

wmi the scores. 
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Finally, this study is from a very select group of students and is only one model or 
view of the factors associated with mathematics achievement. Therefore, the reader is 
reminded that these results should be weighed with previous observations and other 



research findings. 
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Appendix A 



The following variables were either selected from those in the TIMSS Population 3 data 
set or were developed using other variables from the data set. 

1 . Gender: ITSEX 1 = Female 0 = Male 

2. Parent Education: CSDGEDU. This variable was dummy coded into: 





Parent Education 1 


Parent Education 2 


University Graduate 


0 


0 


High School Graduate 


1 


0 


Primary School Graduate 


0 


1 



3 . Advanced Math/Physics: IDSUBPOP Recoded 1= Adv. Math and Physics, 0 = Advanced Math 

4. Attitude (Composite): CSBENJY, CSBMBORE, CSBMEASY, CSBMLDFE, CSBMLIKE. For 
each individual variable 1 = strongly agree 4 = strongly disagree. CSBMBORE and CSBMLIKE 
were reverse coded to match the direction of the others. The variables were added together to 
create the composite. The lower the attitude score the better the attitude towards mathematics in 
general. Alpha = .8241 

5. Natural Talent: CSBMDOW 1 1= strongly agree 4= strongly disagree. Those who chose strongly 
agree indicated that natural talent was the key to mathematics success. 

6. Hard Work: CSBMDOW3 1= strongly agree, 4= strongly disagree. Those who chose strongly 
agree indicated that hard work was the key to mathematics success. 

7. Television: CSBGDAY1 1= No time per school day, 2=Less than one hour per school day, 3= 1-2 
hours per school day, 4= 3-5 hours per school day, 5 = more than five hours per school day. 

8. Sports: CSBGDAY6 1= No time per school day, 2=Less than one hour per school day, 3= 1-2 
hours per school day, 4= 3-5 hours per school day, 5 = more than five hours per school day. 

9. Employment CSBGDAY5 1= No time per school day, 2=Less than one hour per school day, 3= 1- 
2 hours per school day, 4= 3-5 hours per school day, 5 = more than five hours per school day. 

10. Studying Math: CSBGDAY 8 1= No time per school day, 2=Less than one hour per school day, 

3= 1-2 hours per school day, 4= 3-5 hours per school day, 5 = more than five hours per school 
day. 

11. Television: CSBGDAY 1 1= No time per school day, 2=Less than one hour per school day, 3= 1-2 
hours per school day, 4= 3-5 hours per school day, 5 = more than five hours per school day. 




20 







U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 
National Library of Education (NLE) 

Educational Resources Information Center (ERIC) 

REPRODUCTION RELEASE 



(Specific Document) 



ERIC 

T M032081 



I. DOCUMENT IDENTIFICATION: 



T,tle: average; (o^-bHcbec, resWoK 

[ iU^S Acjvjat^ceri^ i>vvbc-c; g xo)V) 

Author(s): a i\a e S & , i b e K 



Corporate Source: 



Publication Date: 



II. REPRODUCTION RELEASE: 



In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents announced in the 
monthly abstract journal of the ERIC system, Resources in EducQtion (RIE), are usually made available to users in microfiche, reproduced paper copy, 
and electronic media, and sold through the ERIC Document Reproduction Service (EDRS). Credit is given to the source of each document, and, if 
reproduction release is granted, one of the following notices is affixed to the document. 



If permission is granted to reproduce and disseminate the identified document, please CHECK ONE of the following three options and sign atthe bottom 
of the page. 



The sample sticker shown below will be 
affixed to ail Level 1 documents 


The sample sticker shown below will be 
affixed to ail Level 2A documents 


The sample sticker shown below will be 
affixed to all Level 2B documents 


PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL HAS 
BEEN GRANTED BY 




PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL IN 
MICROFICHE, AND IN ELECTRONIC MEDIA 
FOR ERIC COLLECTION SUBSCRIBERS ONLY, 
HAS BEEN GRANTED BY 




PERMISSION TO REPRODUCE AND 
DISSEMINATE THIS MATERIAL IN 
MICROFICHE ONLY HAS BEEN GRANTED BY 


A® 




A® 




JP 


c/ 










TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) 


1 




2A 




2B 


Level 1 

t 


Level 2A 

t 


Level 2B 

i 


Ef 


□ 


□ 


Check here for Level 1 release, permitting 
reproduction and dissemination in microfiche or other 
ERIC archival media (e g., electronic) and paper 
copy. 


Check here for Level 2A release, permitting 
reproduction and dissemination in microfiche and in 
electronic media for ERIC archival collection 
subscribers only 


Check here for Level 2B release, permitting 
reproduction and dissemination in microfiche only 



Documents will be processed as indicated provided reproduction quality permits. 

If permission to reproduce is granted, but no box is checked, documents will be processed at Level 1. 



Sign 

here,-* 




/ hereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce and disseminate this document 
as indicated above. Reproduction from the ERIC microfiche or electronic media by persons other than ERIC employees and its system 
contractors requires permission from the copynght holder Exception is made for non-profit reproduction by libraries and other service agencies 
to satisfy information needs of educators in response to discrete inquiries. 


Signature: J a — - . 

dfiuwUA <0. 


Printed Name/PositioiVTitle: 


(j 5n>' c / eo. psy ch 4 


'TT« 4*3 2 Sl4 


W5 3 nno 


E-Mail Address: , 


Dat9: 1 *(3//<r0 



TJ 



(over) 



III. DOCUMENT AVAILABILITY INFORMATION (FROM NON-ERIC SOURCE): 

If permission to reproduce is not granted to ERIC, or, if you wish ERIC to cite the availability of the document from another source, please 
provide the following information regarding the availability of the document. (ERIC will not announce a document unless it is publicly 
available, and a dependable source can be specified. Contributors should also be aware that ERIC selection criteria are significantly more 
stringent for documents that cannot be made available through EDRS.) 



Publisher/Distributor: 



Address: 



Price: 



IV. REFERRAL OF ERIC TO COPYRIGHT/REPRODUCTION RIGHTS HOLDER: 

If the right to grant this reproduction release is held by someone other than the addressee, please provide the appropriate name and 
address: 




V. WHERE TO SEND THIS FORM: 



e ON ASSESSMENT AND EVALUATION 

UNIVERSITY OF MARYLAND 
1129 SHRIVER LAB 
COLLEGE PARK, MD 2074-2 
ATTN: ACQUISITIONS 



►However, if solicited by the ERIC Facility, or if making an unsolicited contribution to ERIC, return this form (and the document being 
contributed) to: * 



ERIC Processing and Reference Facility 

4483-A Forbes Boulevard 
Lanham, Maryland 20706 

Telephone: 301-552-4200 
Toll Free: 800-799-3742 
FAX: 301-552-4700 
e-mail: ericfac@ineted.gov 
WWW: http://ericfac.piccard.csc.com 



FFF-088 (Rev. 2/2000) 



